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We study the fluctuations of the autocorrelation and autoresponse functions and, in particular, 
their variances and co- variance. In a first general part of the Article, we show the equivalence of the 
variance of the response function with the second-order susceptibility of a composite operator, and 
we derive an equilibrium fluctuation-dissipation theorem beyond-linear order relating it to the other 
variances. In a second part of the paper we apply the formalism to the study to non- disordered 
ferromagnets, in equilibrium or in the coarsening kinetics following a critical or sub-critical quench. 
We show numerically that the variances and the non-linear susceptibility obey scaling with respect 
to the coherence length £ in equilibrium, and with respect to the growing length L(t) after a quench, 
similarly to what is known for the autocorrelation and the autoresponse functions. 
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I. INTRODUCTION 



Two-time quantities, such as the autocorrelation function C(t,t w ) and the associated linear response function 
X{t,t w ), describing the effects of a perturbation, are generally considered in experiments, theories and numerical 
investigations. In equilibrium the fluctuation-dissipation theorem (FDT) holds, providing an important tool to study 
coherence lengths and relaxation times by means of susceptibility measurements. 

Beside equilibrium, the pair C and x nas been thoroughly investigated also in slowly relaxing systems, among 
which supercooled liquids, glasses, spin-glasses and quenched ferromagnets, as natural quantities to characterize and 
study the aging behavior. In this context, the fluctuation-dissipation ratio X(t,t w ) = d\/dC was defined [l| in 
order to quantify the distance from equilibrium, where X = 1. Particularly relevant is its limiting value Xoo = 
limt^-^oo limt-^oo X(t, t w ) due to its robust universal properties Complementary to X, the concept of an 

effective temperature T e ff =T/X, has been thoroughly applied in several contexts @, although its physical meaning 
has not yet been completely clarified. Moreover, the fluctuation-dissipation ratio was also proved [7| to be related 
to the overlap probability distribution of the equilibrium state at the final temperature of the quench, providing an 
important bridge between equilibrium and non-equilibrium. Finally, in the context of coarsening systems, the behavior 
of the response function was shown to be strictly linked to geometric properties of the interfaces [H Q , allowing the 
characterization of their roughness, and, in the case of phase-ordering on inhomogeneous substrates, to important 
topological properties of the underlying graph [Io| ■ 

Besides this manifold interest in average two-time quantities, more recently considerable attention has been paid 
also to the study of their local fluctuations, which are now accessible in large-scale numerical simulations |11| and, 
due to new techniques, also in experiments [12j . The reasons for considering these quantities are various: 

- In disordered systems, since averaging over the disorder makes the usual two-particle correlation function (structure 
factor) short ranged even in those cases where a large coherence length £ is present, quantities related either to the 
spatial fluctuations of C [l3l - fll| or to non-linear susceptibilities [3, [lg] have been proposed to detect and quantify £. 

- Local fluctuations of two-time quantities are associated with the dynamical heterogeneities observed in several 
systems which are believed to be a key for local rearrangements taking place in slowly evolving systems [III [13 ■ 
In the context of spin models, it was shown [lj| that these fluctuations can be conveniently used to highlight the 
heterogeneous nature of the system. 

- In [l9| it was shown that in a large class of glassy models the action describing the asymptotic dynamics is 
invariant under the transformation of time t — > h(t), denoted as time re-parametrization. This symmetry is expected 
to hold true in glassy systems with a finite effective temperature but not in coarsening systems, where T e ff = 00 [20| . 
Then, restricting to glassy systems, it was proposed [ljg, Il9j that the aging kinetics could be physically interpreted 
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as the coexistence of different parametrization t — > h r (t) slowly varying in space r. According to this interpretation, 
spatial fluctuations of two-time quantities should span the possible values of C and % associated to different choices 
of h(t). Since the correlation and the response function transform in the same way under the time-re-parametrization 
transformation, the same curve x(C) relating the average quantities is expected to hold also for the fluctuations. 
This property was proposed in [18l . Il9( as a check on the time-re-parametrization invariance, and the results tend to 
conform to this interpretation. 

- In plj it was claimed that, at least in the context of non-disordered coarsening systems, fluctuations of two- 
time quantities encode the limiting fluctuation-dissipation ratio Xoq, similarly to the fluctuation-dissipation relation 
between the fully averaged quantities x and C. 

In the first part of this paper, we discuss the definition of the fluctuating versions Ci,Xi of Cj and Xi on site i, 
and consider their (co-)variances V^j — (CjCj) — CjCj, V*-, and V^ x (defined analogously to V^). We present a 
rather detailed and complete study of these quantities and their relation with a non-linear susceptibility V*- (defined 
in Eq. [16]) related to the fluctuations of Xi introduced in [l6j]. We show that, for i ^ j, the variance V£ of % 1S 
equal to Vfy This allows us to derive a relation between V$ ', V*- and V? x , which can be regarded as a second order 
fluctuation-dissipation theorem (SOFDT) relating these quantities in equilibrium. The SOFDT holds for every choice 
of t and t w and of i, j and is completely general for Markov systems. It represents also a relation between the second 
moments of Ci and Xj f° r i 3i but not for i = j because, in this case, V,* cannot be straightforwardly interpreted as 
a variance. Prompted by the SOFDT, we argue that Vy, rather than V%, is the natural quantity to be considered, on 

an equal footing with the variances V£j and x , to study scaling behaviors, and to detect and quantify correlation 
lengths. Being a susceptibility, V could in principle be accessible in experiments. 

These ideas are tested in the second part of the paper, where we study numerically the behavior of V£j , V^ x and 
of V* in non-disordered ferromagnets in equilibrium or in the non-equilibrium kinetics following a quench to a final 
temperature T at or below T c . Restricting to the cases with T > T c the same problem has been recently addressed 
analytically by Annibale and Sollich [22| in the context of the soluble spherical model. Here we carry out the analysis 
in the finite-dimensional Ising model, focusing particularly on the scaling properties. Focusing on the k = Fourier 
component V£L — (1/iV) ^ - =1 Vfj (and similarly for the other quantities) our results show a pattern of behaviors 
for V£l q , V fe _^| and V?_ similar to what is known for C and x- In particular, in a quench at T c , one finds the 
asymptotic scaling form V£L Q (t, t w ) oc V k J^(t, t w ) oc V%__ (t, t w ) oc t^f(t/t w ), where the exponent b c = (4 — d — 2r\)jz c 
can be expressed in terms of the equilibrium static and dynamic critical exponents r\ and z c , in agreement with what 
was found in (22|. In quenches below T c , in the time sector with t w — > oo and t/t w = const., usually referred to as 
aging regime, we find a scaling form V£L (t,t w ) = tf c f(t/t w ) (and similarly for V k x Q and V^_ ), where, in contrast 
to the critical quench, ac and / are genuinely non-equilibrium quantities that cannot be straightforwardly related to 
equilibrium behaviors. 

Our results allow us to discuss also the issue of a direct correlation between the fluctuating parts of C and x> as 
predicted for glassy systems by the time-re-parametrization invariance scenario. In the aging dynamics of coarsening 
systems, we find that for large t/t w the ratio V x /V c diverges, both in the quench at T c and below T c . This implies 
that C and X are not related as to follow the curve x(C): m contrast with the above mentioned scenario. 

This paper is organized as follows: in Sec. |TI]we introduce and discuss general definitions of the fluctuating quan- 
tities, their variances and co-variances; in Sec. IIIII we discuss the relations among them and with the second-order 
susceptibility V x . In Sec. [lV]we specialize the above concepts to the case of ferromagnetic systems. We study the 
behavior of V c , V Cx and V x in equilibrium in Sec. IIV A[ relating their large t—t w behavior to the coherence length 
in Sec. IIV A II The non-equilibrium kinetics is considered in Sec. IIVBI critical quenches are studied in Sec. IIVB II 
while Sec. IIV B~2l is devoted to sub-critical quenches. The results of these Sections are related to the issue of time-re- 
parametrization invariance in Sec. IIV Cl Last, in Sec. [V] we summarize, draw our conclusions and discuss some open 
problems and perspectives. Four appendixes contain some technical points. 

II. FLUCTUATING QUANTITIES AND VARIANCES 

Let us consider a system described by a set of variables <jj defined on lattice sites i. In order to fix the notation we 
consider discrete variables, referred to as spins, the evolution of which is described by a master equation. The results 
of this paper, nonetheless, apply as well to continuous variables subjected to a Langevin equation (specific differences 
between the two cases will be noticed whenever the case). The auto-correlation function is defined as 



Ci(t,t w ) = (<Ti(t)<Ji(t w )) - ((7i{t))(<Ji(t w )). 



(1) 
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Using the symbol ^ to denote the fluctuating quantities whose average gives the usual functions, one has Ci(t,t w ) 
[<Ji{t) — (ci(t))][ai(t w ) — (<Ji(t w ))]. The (auto-)response function is defined as 

( . . s rp C S{ai(t)) h 



6hi(t>) 



(2) 



h=0 



where (. . .}h means an average over a process where an impulsive perturbing field h has been switched on at time t' . 
Notice that a factor T has been included in the definition ([2]) of the response. The presence of the derivative in Eq. 
([2]) makes a definition of a fluctuating part of Xi n °t straightforward in the case of discrete variables (see Appendix I 
for a discussion of a possible definition of Xi based on the definition where the perturbation hi is present). This 
problem can be bypassed using an out-of-equilibrium fluctuation-dissipation relation 



(3) 



where in the limit of vanishing h the derivative of Eq. ([2]) is worked out analytically, and on the right hand side appear 
specific correlation functions (see e.g. Eq. (0 and discussion below) computed in the unperturbed dynamics. Such 
a relation has been obtained in different forms in [l6|, I23T4291 ] . This allows one to introduce a fluctuating part of the 
susceptibility defined over an unperturbed process. Eq. ([3]) is at the basis of the so called field-free methods for the 
computation of response functions allowing the computation of Xi without applying any perturbation. 
With the quantities introduced above, one can build the following (co-)variances 



(SCi{t,t w )6C j(t,t w )} 



V? x (t,t w ) = (SCiit^Sxjit,^)) 



(4) 
(5) 
(6) 



where, for a generic observable A, we have defined 5 A = A — (A). Notice that we restrict the analysis to variances 

sites but with the same choice of times t,t w . V$ (t, t w ) 
to study cooperative effects in disordered systems, usually denoted 



obtained by taking products of two-time quantities on different sites but with the same choice of times t, t w . V^(t, t w ) 



is the 4-point correlation function introduced in [1J 
as C4. 

As discussed in [26|, [3(| , for a given unperturbed model, there are many possible choices of the perturbed transition 
rates, which give rise to different expressions for \i- However, as shown in (30j . and further in Appendix I, we 
expect all these choices to lead to approximately the same values of the variances introduced above (with the notable 
exception of the equal site variance V?[, which, however, is not of interest in this paper). Then, in the following, we 
will consider the expression 
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ai(t)ai(t) - a^ai^) - ai{t) j dtiB^tx) 



(7) 



where Bi = — ^2 a >[(Ji — ai]w(a'\a), w{a'\a) being the transition rate for going from the confi gur ation a to a'. This 
form has been obtained in [26] (and, in an equivalent formulation, for continuous variables in [161 123|). 

The relation ([3]) with the choice ([7]) has the advantage of a large generality, holding for Markov processes with 
generic unperturbed transition rates, both for continuous and discrete variables. Oth er p ossible relations between 
the response and quantities computed on unperturbed trajectories have been proposed [U HH, H3, HU but we do not 
consider them here because, as discussed in [30|, in those approaches either the response is not related to correlation 
functions of observable quantities in the unperturbed system, as in 0, US [Hj], or, in the case of Ref. [25], it is 
restricted to a specific systems (Ising) with a specific (Heat bath) transition rate. 

The k = Fourier component of the correlation and response functions are usually considered to extract physical 
information, such as spatial coherence or relaxation times, from the (unperturbed) system under study. The k = 
mode V£L (t,t) of the variance of C, defined through 



1 N 

i,j=l 



(8) 



has been considered to access the same information in disordered systems. This might suggest that the same informa- 
tion is contained in the k = component of the other variances. Notice that, for V x , the sum ((5]) includes the equal 
site term V£ which, as anticipated, takes different values according to the specific choices of the fluctuating part of 
the response. We will deal with this problem later. 
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III. EQUILIBRIUM RELATION BETWEEN VARIANCES AND NON-LINEAR SUSCEPTIBILITIES 

In this section we derive a relation between the variances and the non-linear susceptibility V x (defined in Eq. I L6[) 
that will be interpreted as a second-order fluctuation-dissipation theorem (SOFTD) relating these quantities. We 
sketch here the basic results, further details and formalism are contained in Appendix II. 

Let us start by recovering the usual FDT. In equilibrium, using time translation and time inversion invariance, 
namely the Onsager relations, it can be shown [l6| that 

(ai^Biitx))^ = - J-<a i (t)<T i (ti)} eg , (9) 
Cti 

valid for t > t\. Plugging this relation into Eqs. (|3I7[) one retrieves the usual fluctuation-dissipation theorem 

(Di{t,t w ))=Q, (10) 

where we have introduced the quantity 

Di(t,t w ) = x<(t,tw) + Ci(t,t w ) - Ci(t,t). (11) 

Notice that, for Ising spins <7; = ±1, Ci(t,t) = 1 and does not fluctuate. 

The next step is to seek for a relation holding between the variances. Since the mechanism whereby this relation 
is obtained is different for equal or different sites i,j (due to the sensitivity of V% to the choice of Xi); we s P n t the 
arguments into separate sections. 



A. i/j 

Defining the second moment of Di as Vff(t,t w ) = (6Di(t,t w )5Dj(t,t w )), and using the equilibrium property ^ it 
is easy to show that 

VP (t,t w ) = V x (t,t w ) + 2V^(t,t w ) + V^(t,t w )-V^'(t,t). (12) 

Proceeding in a similar way as done in the derivation of Eq. (|10[) . in Appendix II we show that, for i ^ j, the r.h.s. 
of Eq. (fT2|) vanishes in equilibrium. Hence we have the following SOFDT 

V i f(t,t w )=0. (13) 

This relation holds for every choice of the fluctuating part of x- Indeed, we have already noticed that on different sites 
i,j the variances involved in the r.h.s. of Eq. (|12[) are independent on that choice. Interestingly, Eq. (I13[) shows that 
not only the first moment of Di vanishes (due to the FDT (fTU|)'). but also the second moment. Moreover, as shown 
in Appendix I, the equal site variance V® is not zero (due to the divergence of the term Kf (or Kf) appearing in 
V£, see Eqs. (foTil) . (HJ)), indicating that D is not identically vanishing, and hence it is a truly fluctuating quantity. 
This leads to the surprising conclusion that D is an uncorrelated variable for any choice of i,j and of t,t w , and in 
any equilibrium state of any Markovian model. This observation, which might have far reaching consequences, will 
be enforced in Sec. IIVI to disentangle quasi-equilibrium correlation from the genuine non-equilibrium ones in aging 
systems. 



B. i=j 

For i — j a relation such as Eq. (fTOj) cannot be satisfied for any choice of the fluctuating part of x- I n order 
to show that, let us first observe that, recalling Eq. (fT2"|) . if Eq. (TT3l were to hold also for i = j, the quantity 
-2V° x (t,t w ) - V£(t,t w ) + Vg(t,t) should equal Vg(t,t w ). This quantity can be easily computed, yielding 

- 2V° x (t,t w ) - V?(t,t w ) + V£(t,t) = - X 2 S,t w ) - Ai(t,t w ), (14) 

where Ai(t,t w ) — 2(Ci{t,t w )xi{t 1 t w )) + {Cf(t 7 t w )) — {Cf(t,t)) is a quantity which vanishes for Ising spins, as can be 
easily shown using the definitions of Ci and Xi an d the property (|65p. On the other hand, computing directly 
leads to the result (see Appendix I) 

V*(t,t w ) = -xKWw) - A^t^+Kfit,^), (15) 



5 



where Ki, given in Eq. (|60|) . is a quantity that has been studied in specific models in [3(| and found to be positive and 
diverging as t — t w increases. Expression (|15l) is different from the r.h.s. of Eq. (fTl)) . thus proving that the SOFTD 
does not hold for i = j. Worse, the quantity Kf appearing in Eq. (|15|) prevents the possibility of any direct relation 
between the variances because it introduces an explicit time-dependence. 



C. The non-linear susceptibility Vf,(t,t v 



In order to remove the asymmetry between i = j and i ^ j and proceed further, the idea is to search for a quantity 
Vfj related to V% such that VXy = while on equal sites the equilibrium value of Vf equals the r.h.s. of Eq. (|14l) . 
This would allow one to arrive at a pair of relations analogous to Eqs. (|13I12[) for any ij. As shown in Appendix III, 
the second order susceptibility 



dti / dt2 



*a)-i2j(*,*i)i2j(t,ta) 



(16) 



where 



8hi(ti)5hj(t2 



(17) 



/i=0 



is the non-linear impulsive response function proposed in [161 ] to study heterogeneities in disordered systems, meets 
the requirements above. Then, recalling Eq. (TUT) , one has the relations 



and 



vB{t,t w ) = o, 



v£(t, *„,) = v*(t, t w ) + 2i#*(t, t„) + v£(t, t w ) - v£(t, t) 



(18) 



(19) 



formally identical to Eqs. (|13|12[) . but holding for every choice of the sites i, j and hence also for the k — component, 
namely 



Vj± (t,t w ) = 0. 



(20) 



In summary, one always has an equilibrium relation (Eq. (j!8[) or (|20[) ) between the second order response defined 



in Eqs. (|16I17[) and the variances V^j and x . In the case of different sites i ^ j, this non-linear response is also 
the variance of Xi whereas on equal sites there is no analogous interpretation, and neither it is possible to obtain a 
relation involving directly V£. 

Coming back to the problem discussed at the end of Sec. HU namely the possibility of extracting physical information 
on the unperturbed system from the k = mode of the variances, some considerations are in order. First, it is clear 
that, concerning V fe *i , its value changes depending on the way the perturbation is introduced (via the term V£). 
In this way this quantity mixes information regarding the perturbation with those of interest. The quantity Vf =Q , 
instead, does not suffer from this problem, since its equal site value can always be related to quantities that do not 
depend on the choice of the perturbation. Moreover, for large times, V£_ (defined analogously to Eq. ©) turns out 
to be dominated by the equal site contribution. Indeed, whatever definition of Xi is adopted, either the quantity Kf 
or Kf come in (see Eqs. (|61I62[) ) . which are either infinite {Kf) or diverging with increasing t — t w (Kf). These 
considerations suggest the use of Vf =0 . Indeed it has been shown in specific cases [l6| that this quantity contains 
information on relevant properties, among which the coherence length, similarly to the variance Vfj and therefore has 
an important physical meaning. 



IV. FLUCTUATIONS IN FERROMAGNETS 



Specializing the general definitions given above to the case of ferromagnetic systems, in this Section we study the 
behavior of the k = mode of the quantities introduced above in the Ising model in equilibrium (Sec. IIV Ap and in 
the non-equilibrium kinetics following a quench to T c (Sec. IIVB 1[) or below T c (Sec. IIV B 2[) . Our main interest is 
in the scaling of these quantities with respect to the characteristic length of the system. From this perspective, it is 
quite natural to focus on Vf =0 rather than on Vjf =0 . Indeed we will show that in any case V£L , V^ Q and Vf =0 obey 
scaling forms from which a correlation length can be extracted. On the other hand, as already anticipated, these 
scaling properties are masked in VjfL by the term Kf or Kf. 
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A. Equilibrium behavior 

Here we consider the behavior of V c , V Cx and V x in equilibrium states above, at, and below T c . In the last case, 
we consider equilibrium within ergodic components, namely in states with broken symmetry. 



1. Limiting behaviors for t — t w = and for t — t w — >• oo 



Before discussing the scaling properties of V c , V Cx and V x , let us compute their limiting behaviors for small and 
large time differences t — t w . From the definitions (|4I6|16|) one has V£j[t, t) = V^' x (t,t) — V£(i,t) — 0, and the 
same for the k = component. One can compute analytically also the limiting values attained in equilibrium by V c , 
V c,x and V x for t — t w — » oo, relating them to the usual static correlation function. Indeed, with the definitions of 
Sec. [ill all the quantities considered are written in terms of two-times/two-sites correlation functions. For large time 
differences these correlation functions can be factorized as products of one time quantities resulting in the following 
behavior (details are given in Appendix IV) 



Vg(oo) = jim Vg(t -t w ) = C ij>eq {C ijteq + 2m 2 ) 
v£*(oo) = lim Vg*(t-t w ) = -m 2 C ij , eq 
V*(oo) = Jim^ Vg(t - t w ) = -Cf jteq , (21) 



where m is the equilibrium magnetization and C\j^ e q = ( cr i cr j)e(j — Ti 2 is the static correlation function. 

For the k = components, from Eqs. (|2ip for T > T c , using the scaling Cij >e g ~ K — i| 2_d , '/(|* — where £ is 
the equilibrium coherence length and i — j the distance between i and j, one has 

V^ (oo) = -V? =0 (oo)oc^% (22) 

where 

P c = 4 - d - 2r] (23) 
is an exponent related to the critical exponent r?, and 

C» = 0, (24) 

because m = 0. For V^L (oo) and V^ =0 (oo) the same result holds true also below (but close to) T C) since the terms 
containing the magnetization in Eqs. (|2"Tj) can be neglected. Interestingly, the behavior of Vj?J ( (oo), on the other hand, 
is discontinuous around the critical temperature: It vanishes identically for T > T c while it diverges as — (T c — T) 2/3 ~ 7 
(where 7 = (2 — rf)v and /? are the usual critical exponents) on approaching T c from below. 



2. Scaling behavior 

We turn now to the point we are mainly interested in, namely the scaling behavior of V c , V x and V x . To 
ease the notation let us introduce the symbol V x , with X — C, X — C\, and X — \i to denote V c , V Cx and 
V x , respectively. Approaching the critical temperature the coherence length diverges and hence a finite-size scaling 
analysis of the numerical data will be necessary in Sec. IIV A 31 Let us discuss here how such an analysis can be 
performed. For a finite system of linear size C we expect a scaling form 

V k l (t t w ) = C^f x ( ^~ t l~ t \ |) (25) 

where to is a microscopic time, z c is the dynamic critical exponent, and fx{x,y) a scaling function (in the following, 
in order to simplify the notation, we will always denote scaling functions with an /, even if, in different cases, they 
may have different functional forms). Away from the critical point, matching the large t — t w behavior of Eq. (|25|) 
with the large time difference limits V,£, V*, of Eq. (|2"21 implies fc{ x ,y) ~ fx( x >v) ~ I ■ Since only the ratio 
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£/£ must enter fx this fixes the exponents /3c = P x = Pc- Finally, Eq. (1201 implies that also Pc x takes the same 
value and, in conclusion 

Px = Pc (26) 
for all the quantities. Letting £ Zc = (t — t w — to) in Eq. (f2"S")) implies 

where /x [(t — t w — to)/£ Zc ] is a shorthand for fx [1, (i — — ^o)/£ 2c ], an d & c = Pc/ z c - Assuming that there is no 
dependence on £ for small time differences t — t w leads to fx{x) ~ const in this regime. This implies 

V^o(*-*t )~(t-t™-to) 6a (28) 

for -t ) <Cf e - 

5. Numerical studies 

In this Section we study numerically the equilibrium behavior of the two-dimensional Ising model, where z c ~ 2.16 
and b c ~ 0.69, and check the scaling laws derived above. 

Before presenting the results let us comment on the method used to compute the k = components. For T ^ T c , 
for any t and t w , V*(t — t w ) decay over a distance i — j at most of order of £. Then, performing the sum in Eq. © 
over the whole system one introduces a number of order [(£ — £)/£] d of terms whose average value is negligible. 
However, due to the limited statistics of the simulations, such terms are not efficiently averaged and introduce noisy 
contributions which, with the definition ((SJ) sum up to produce an overall noise of order [(£ - £)/£] d/2 - For C much 
larger than £ this quantity is large and lowers the numerical accuracy. Therefore, since one knows that the average 
of that noise is zero, the most efficient way of computing V^L is to sum only up to distances i — j = I > £. We have 
checked that the two procedures (namely summing over all the sites i,j of the system or restricting to those with 
i — j < I) give the same results within the numerical uncertainty. We anticipate that in the study of non-equilibrium 
after a quench below T c presented in Sec. IIVB~2l similar considerations apply with £ replaced with L(t), the typical 
size of domains. Clearly, at T c where £ = oo such a procedure cannot be applied and the sum must be performed over 
the whole system. 

Starting from the case T > T c , in the left part of Fig. Q] we plot V c , V C ' X and V x as functions of t — t w . V£L 
and — V^ =0 grow monotonically to the same limit (|22[) . while V^Jq has a non monotonic behavior vanishing for large 
time differences. In the inset, by plotting VE_ (t,t w ) (we recall that V^L (t,t) = for Ising spins) we confirm the 
SOFDT PP]). 

In the case of quenches below T c (right part of Fig. [T]), we obtained the broken symmetry equilibrium state by 
preparing an ordered state (i.e. all spins up) and then letting it relax at the working temperature to the stationary 
state. In this case the behavior of V , V c,x and V x is similar to the case T > T c , with the difference that also V^ =0 
has a non monotonic behavior. We have checked that for temperatures close to T c , both above and below T c (i.e. for 
T = 2.28 and T = 2.25) V c , V ' x and V x grow as (t — t w — to) bx with bx consistent with the expected value b c , as 
expressed in Eq. (f28)) . 

In order to study the critical behavior we have equilibrated the system at T c using the Wolff cluster algorithm [3l[ . 
In Fig. [5] we present a finite size scaling analysis of the data. In view of Eq. ([23)1 we plot £ _1 ' 45 V fc c L for different 
C against (t — t w — t )/£, Zc , where t = 0.475 and the exponent 1.45 (in good agreement with the expected value 
Pc = 1.5) have been obtained by requiring the best data collapse. All the data exhibit a nice collapse on a unique 
master-curve. The master-curve grows initially as a power law with an exponent 0.69 in good agreement with b c , as 
expected from Eq. ([2"5]) . and than tends toward saturation for t — t w + to 3> C Zc . A similar behaviour is observed for 
the other V c \ V Cx , apart from the sign, since V£ =0 and V^Lg are negative for large t — t w . 

B. Non equilibrium 

1. Critical quench 

In this Section we consider a ferromagnetic system quenched from an equilibrium state at infinite temperature to 
T c . Numerical results are presented for d = 2. In d = 3 the situation is qualitatively similar although our data are 
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FIG. 1: (Color online). V£L (t — t w ), —V£ =0 (t — t w ) and —V^* (t — t w ) are plotted against t — t w in equilibrium conditions at 
T = 3.5 > T c (left panel), where £ ~ 1.98 and at T = 1.5 < T c (right panel) where £ ~ 0.88. In the insets VjL (t,t w ) is plotted 
against t — t w - The system size is C — 10 3 and I = 10 2 . 



£=100 




(t-t w -t )/ L> 

FIG. 2: (Color online). C~ 1A5 V£L (t — t w ), is plotted against (t — t w — to)/C Za (with to = 0.475), in equilibrium conditions at 
T c for different values of C. The dashed line is the expected power-law behavior [(t — t w — to)/C Zc ] (b c = 0.69). In the inset 
V^L (t, t w ) is plotted against t — t w for C = 10 3 . 

too noisy to extract precise quantitative information. With T = T c we expect a scaling form as in Eq. (|25|) where the 

1 1 z 

role played by C is now assumed by L(t w ) ~ tj c . Letting t — t w ^> to, one has 

V k l (t,t w )~%f x (J-y (29) 

where fx (t/t w ) is a shorthand for fx (t/t w , oo), and the short time behavior (|28l) . Notice that this scaling, together 
with the equilibrium one (I27p . are consistent with the results of Ref. [22J where the same forms are obtained with 
b c = (4 — d — 2t])/z c — (4 — d)/2, since in the spherical model 77 = and z c = 2. 

The behavior of V , V C ' X and V x is shown in Fig. [3] By plotting i^°' 66 V^ (i, vs (i — t w )/t w one observes a 
good collapse of the curves for [t — t w )/t w sufficiently large. Lack of collapse for t — t w < to is expected due to the 
to-dependence in the scaling form (|25p and those derived from it. The exponent 0.66 is in good agreement with the 
expected one b c — 0.69, and this confirms that the scaling (f29|) is obeyed. In the short time difference regime, for 
t — t w t w , these quantities behave as in equilibrium, and in particular the relation (|20[) is obeyed, as it is shown 
in the inset of the left panel of Fig. [3J For t — t w ^ t w the relation (|2U)) breaks down and the asymptotic regime 
is entered. In this time domain V c and V Cx approach constant values in the large t limit. For V£L this can be 
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FIG. 3: (Color online). t~ ose 'V^L (t - t w ) (left panel, log-log scale), -t^,° B6 V^ (t - t w ) (right panel, log-log scale) and 
— t^,°' 66 V£ =0 (t — t w ) (inset of right panel, log-linear scale) are plotted against (t — t w )/t w for a quench to T c in d — 2. In the 
inset of the left panel Vj? =0 (t,t w ) is plotted against (t — t w )/t w . 



understood as follows: Writing the sum (|8]) as an integral 

V k C =0 (t,t w ) = J dr V c {r,t,t w ) (30) 
where r = \i — j\, and invoking the clustering property, by factorizing V (r, t,t w ) for t — > oo, one has 

V£L (t,t w ) ~ / dr C r {t w )C r (t). (31) 



Using the scaling of the correlation function C r (t) = t ^ d 2 + ? ')/ Zc /(r/t 1 / Zc ), with the small x behavior f(x) 
x -(d-2+ v )^ Eq (J3YJ) becomes 



lim V£ =0 (t,t w ) = d% (32) 



with c = J d d xx ^ d 2+n ^ f(x). Notice that the asymptotic value (|32l) approached by VuL Q (and V^Jq) are increasing 
functions of t w . This mechanism makes limt^-yoo limt^oo V^L (t, t w ) — oo, and in this sense the limit (|22[) is recovered, 
bearing in mind that £ = oo. Moreover, limt^^oo limt-yoo V k ^(t, t w )/V£L (t, t w ), is a i^-independent constant as was 

found in |2ll| . We also observe that v£l? Q going to a constant value is a different behavior with respect to the spherical 
model [221 ] . where this quantity vanishes for t — > oo. The quantity V^ =0 has a different behavior, in that it diverges 
for t — » oo for any value of t w . Therefore, at variance with V£L and V^.Jq, the limit (|22|) is always recovered, 
irrespectively of t w . This is a general property of susceptibilities. Considering the linear case for simplicity, from 
Eq. (|4T|) one sees that Xi can be written as an average of a one-time quantity over a process where the Hamiltonian 
is changed at t w . Since the average of a one-time quantity must tend to its (perturbed) equilibrium value for large 
t (even if the Hamiltonian has been modified at t w ), this explains why limt-^oo Xi(t, t w ) is independent of t w . An 
analogous argument holds for V* . Indeed, recalling Eqs. (l43l53|) . for i ^ j also this quantity can be written as an 
average of a one-time quantity. The same property holds for the equal site contribution since, according to Eq. (|14p . 
it is V^(t,t w ) — —Xi(t,t w ). The limit (1221) is then satisfied irrespectively of t w . 



2. Quench below T c 

In this Section we consider a ferromagnetic system quenched from an equilibrium state at infinite temperature to 
T < T c , in d = 1,2. 

Let us recall the behavior of C and x in a quench from T = oo to T < T c . In the large-i^, limit C obeys the 
following additive structure [321 ] 



C(t,t w ) — C s t(t t w ) + C a g(t,t w ). 



(33) 
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Here C s t is the contribution provided by bulk spins which are in local equilibrium. This term vanishes for quenches 
to T = 0. C ag (t, t w ) is the aging contribution originated by the presence of interfaces which scales as 

C ag (t,t w )=t- b f(j- S j, (34) 

with 6 = and the property [j| 

f(x) ~ x- x (35) 

for large x, where A is related to the Fisher-Huse exponent. 

A decomposition analogous to Eq. (|33[) holds for \(t, tw), with Xst{t — t w ) = Xeq{t — t w ) — C eq {t, t) — C eq {t, t w ) and 

Xa 9 (t,t w )=t~ a g(j-^ , (36) 

with g behaving as Q 

g(x) ~ x- a (37) 

for large x. The exponent a depends on spatial dimensionality so that a > for d > di, di being the lower critical 
dimensionality, and a = for quenches at d = di with T = [5j, |8|, I lOL |33j. Notice that, at variance with the critical 
quench, the non-equilibrium exponents are not related to the equilibrium ones, since the additive form (|33[) splits 
them in separate terms. 

The addictive structure (|3"3")l , which is expected also for the V x , opens the problem of disentangling the stationary 
from the aging contributions to allow the separate analysis of their scaling properties. In order to do this one 
usually enforces the knowledge of the time-sectors where the stationary and the aging terms contribute significantly. 
Specifically, working in the short time difference regime, namely with t w — > oo and f — t w finite, the aging term is 
constant and one can study the behavior of the stationary one. On the contrary, in the aging regime with t w — > oo 
and t/t w finite, C s t(t — t w ) ~ and one has direct access to C ag . The same procedure can be applied to isolate the 
stationary and aging contributions to the V x , as will be done in Section liVB 21 However, in so doing one effectively 
separates the two contributions only in the limit t w —> oo. In numerical simulations, where finite values of t w are used, 
a certain mixing of the two is unavoidable and may affect the results. Furthermore, this technique fails in systems 
where (in contrast to the ferromagnetic model considered here) we do not have a precise knowledge of the time sectors 
where stationary and aging terms contribute. 

For the V x a more elegant and effective technique to isolate the aging from the stationary terms relies on the 
SOFDT. Indeed, according to Eq. (|18p. an exact cancellation occurs in V D between the stationary (equilibrium) 
terms, so that only the aging behavior is reflected by V D . In other words, recalling the discussion at the end of 
Section fill Al the quantity D does not produce any correlation in equilibrium and hence what is left in V D are the 
correlations due to aging. This fact will be enforced in Section IIV B 21 

Let us now consider the behavior of V c , V c,x and V x in d = 1, 2. 



d=l, quench to T=0 

As explained in [BJ the dynamical features of a system at the lower critical dimension quenched to T — are those 
of a quench into the ordered region, rather than those of a critical quench, due to a non- vanishing Edwards- Anderson 
order parameter qEA = hffij^oo lim tro _ i . 00 C(t, t w ). Since at T = there are no stationary contributions we expect 
Vfc=o(MuO = VL=o,ag(M»), with the scaling 

V k l , ag (t,t w )=tl*f x (j-y (38) 

The behavior of these quantities is shown in Fig. [31 By plotting tw 1 ^ 2 V x (t,t w ) vs t/t w one observes an excellent 
collapse of the curves (tiny deviations from the mastercurve for small values of t — t w are due to the ^-dependence, 
as discussed above). This implies that Eq. (|38|) is obeyed with ax — 1/2. Notice that, for large values of t/t w , V c 
and V Cx seem to approach constant values whereas V^ =0 grows as V x oc t 1 ' 2 . Then one has the limiting behavior 
fx(x) ~ x Xx , with values of the exponents consistent with Ac = Ap x = and A x = 1/2. 



d=2, quench to < T < T c 
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In this case we consider quenches to finite temperatures, and hence stationary contributions are present. We expect 
that one can select between the stationary and the aging contributions to V (t,t w ) by considering the short time 
limit and the aging regimes separately. In the former case, only the stationary terms contribute and then we expect 
the relation (f^Uj) to be obeyed. This is shown in the inset of the left panel of Fig. [5] where the relation (f2"U| is observed 
to hold for t — t w < t w . In the aging regime one selects the aging contribution scaling as in Eq. (|38|) . Indeed, 
by plotting in Fig. [5] t~ ax V x (t, t w ) vs (t — t w )/t w one observes an asymptotic collapse of the curves with ac = 1 
and ac'x = a x = V^- A residual t w dependence can be observed (particularly for V c ) that tends to reduce on 
increasing t w . This suggests interpreting this corrections as being produced by the stationary contributions which, 
due to the limited values of t w used in the simulations, are not yet completely negligible. A clear confirmation of this 
interpretation comes from the inspection of the behavior of Vj£. in the inset of the left panel of Fig. [5] Indeed one 
observes that, at variance with VuL , this quantity exhibits an excellent scaling for every value of t w , due to the fact 
that the stationary contributions do not contribute to V^L . This suggests the use of V^L to study aging behaviors 
in more complex non-equilibrium systems, such as spin glasses, where the nature of the stationary contribution has 
not yet been clarified. 

The results for V c in d = 1 and d = 2 suggest that the scaling exponent depends on space dimension as ac = d/2. 
This can be understood on the basis of an argument which, for simplicity, is presented below for the case d = 1. 
Let us consider an interface / at position xj(t w ) at time t w . Suppose that at time t, / has moved to a new position 
xi(t) > xi(t w ). To start with, let us suppose that / is the only interface present in the system and that t — t w <i w . 
Let us indicate by IZi the region where Ci(t,t w ) = — 1 (in the present case the region x(t w ) < i < x(t) swept out by 
the interface). Since V$ is the correlation functions of the CVs and the quench is effectively made to below T c , Vj£_ is 
proportional to the volume V(lZi) — xi(t) — xi(t w ) of the region TZi. For t — t w <C t w interfaces can be considered as 
yielding independent contributions and the above argument can be extended to the physical case with many interfaces. 
In doing that one simply has to replace V(lZi) with its typical value V(1Z) obtained by averaging over the behavior of 
all the interfaces. Since the typical value of V(1Z) is L(t) — L(t w ) one obtains V£L (t, t w ) oc L(t) — L(t w ). Repeating 
the argument for generic d one finds V£L (t,t w ) oc L d (t) — L d (t w ). For t — t w > t w the situation is more complex 
because in this time domain another interface J may move into the region swept out by the interface / and one cannot 
disentangle their contributions. The situation simplifies again in the limit t — t w — > oo, because Xi(t) ^> Xi(t w ) (we 
assume, without loss of generality, that I has moved in the direction of increasing i). In this case, in the region swept 
ut by the interface, the configuration of the system at t w was characterized by many domains of different sign. For an 
interface separating positive spins on the left of it from positive ones, Ci(t,t w ) is equal to the sign of the domain to 
which the i-th spin belonged at t w . Then, almost all the contributions to V£L cancels, because of these alternating 
signs. The only unbalance between positive and negative contributions comes from the region around Xi(t). Indeed, 
the interface can build up a positive contribution to V£L Q if it is not centered on the middle of the domain located 
there at t w . This contribution is of order L(t w ) (V(1Z) ~ L d (t w ), for generic d) leading to the saturation of V£L Q to a 
t^-dependent value for large t. In conclusion, from the argument above we obtain, in both of the regimes t — t w <C t w 
and t — t w ~> t w , a behavior consistent with Eq. (155)) with ac — d/2 and fc(x) r ^_(x d / 2 — 1) for t — t w <Ct B and 
linij^oo fc{x) — const. The same result is found in the soluble large-N model [20|. Another way to understand 
the behavior of V c is the following: Factorizing for t — t w — > oo as V{? =0 = f dr(ai(t)aj(t))(<Ji(t w )<jj(t w )) , using the 
scaling (<7i(t)aj(t)) = g(r/L(t)) and performing the integral one has 

d d rg{r/L(t))g(r/L(t w )) = L(t w ) d f d d xg{xL{t w ) / L(t))g{x), (39) 



i.e. V£L Q = L(t w ) d f(t/t w ), with lim^oo f(t/t w ) =const. This behavior has been derived in the sector of large t — t w 
but the scaling (13"5)) implies its general validity. A similar result, but for a somewhat different definition of V c is 
found in Ref. [3J]. Going back to the data, the saturation for large t predicted by the above arguments is better 
observed in d = 1 (Fig. [4]) while in d — 2, due to computer time limitations, the data of Fig. [5] only show a tendency. 

The data for V fc= Q (t, t w ) and V% =0 (t, t w ) collapse with an exponent consistent with ac x = a x = 1/2. For large 
values of (t — t w )/t w , V^ =0 grows as V x oc t 1 / 2 while V Cx approach a constant value, similarly to V c ' . In conclusion, 
our data show that ac — d/2, ac x = a y = 1/2, and Ac = Ac x = 0, A x = 1/2 hold for d = 1,2, suggesting that this 



might be the generic behavior for all d [35 



C. Time-re-parametrization invariance 

In a series of papers [l9j it was shown that the action describing the long time slow dynamics of spin-glasses 
is invariant under a re-parametrization of time t —¥ h{t). Since C and x have the same scaling dimension the 
parametric form x(C) is a l so invariant under time reparametrizations. Elaborating on this, it was claimed that 




FIG. 4: (Color online). t^^V^L^t — t„) (left panel, log-log scale), —t^^VjE^ft — t w ) (right panel, log-log scale) and 
— Ara 1/,2 VfcL (t — (inset of right panel, log-linear scale) are plotted against (t — t w )/t w for different values of t w in the key in 
a quench to T — in d — 1. 




FIG. 5: (Color online). t^V^Loit - t w ) (left panel), -t w 1/2 V^ (t - t w ) (right panel) and t w 1/2 V% =0 (t - t w ) (inset of right 
panel) are plotted against (t — t w )/t w for different values of t w in the key in a quench to T = 1.5 in d — 2. In the inset of the 
left panel V]? =0 (t,t w ) is plotted against (t — t w )/t w . 

the long time physics of aging systems is characterized by Goldstone modes in the form of slowly spatially varying 
reparametrizations h r (t), similarly to spin waves in O(N) models. According to this physical interpretation, it was 
conjectured that fluctuating two-time functions measured locally by spatially averaging over a box of size / centered 
on r, i.e. C r (i, t w ) = J2i Ci(t, t w )6(l — | i — r\) and similarly for x r (i, t w ), should fall on the master-curve x(C) °f the 
average quantities in the asymptotic limit where t and t w are large. This was checked to be consistent with numerical 
results for glassy models in Refs. [l8j]. The choice of I should be such that I ~ R(t), where R(t) is the typical length 
over which the h r (t) variations occur. 

Let us first observe that, with the definitions © and the discussion of I at the beginning of Sec. lIV A~3l the variances 
VkLo an< ^ ^k=o considered in this paper coincide with the variances of the fluctuating quantities C r , \ r introduced 
above, provided that / is the same in both cases. Our results for V^L Q , therefore, allow us to comment on this issue. 
Before doing so, however, let us recall once again that V x is not the variance of the fluctuating x- Hence, from 
the analysis of V% =0 one cannot directly infer the properties of % O n the other hand, it is clear that x cannot fit 
a priori into the time-re-parametrization invariance scenario, since its variance contains the diverging terms Kf or 
Kf of Eqs. (|15l62p . according to Eqs. (|58l6ip . Hence, the numerical results contained in [18] . which are obtained by 
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switching on the perturbation, can only be consistent with that scenario if a sufficiently large value of the perturbation 
h is used in the simulations, so that the first contribution on the r.h.s. of Eq. (p2")) can be neglected. 

The results of Sec. HVBl show that lim tra _ i . 00 lim^oo V% =0 /V£L = oo, both in the quench to T c and below T c . Since 
yx > yx ( see Eq or Eq. (|61l) ) this implies that the fluctuations x an d C cannot be constrained to follow the x(C) 
curve, at least in this particular order of the large time limits, as already noticed in pH |. Hence the interpretation 
of [H,[3 cannot be strictly obeyed. This may indicate either that the symmetry t — >■ h(t) is not obeyed in coarsening 
systems, as claimed in [20J, or that its physical interpretation misinterprets the effects of time-re-parametrization 
invariance in phase-ordering kinetics. Actually, the results of [21] show that at least the limiting slope Xoo of x(C) is 
encoded in the distribution of C and % Whether this feature might be physically interpreted as a different realization 
of time-re-parametrization invariance in coarsening system is as yet unclear. 

V. CONCLUSIONS 

In this paper we have considered the fluctuations of two-time quantities by studying their variances and the related 
second-order susceptibility. In doing that a first problem arises already at the level of their definition. While Cj is 
quite naturally associated with the fluctuating quantity \o~i(t) — (<7i(t)}][ai(t w ) — (cri(t w ))], for Xi the situation is not as 
clear. Actually, referring to the very meaning of a response function the straightforward way to associate a fluctuation 
to Xi would be the choice of Eq. (pf2")l which is defined on a perturbed process. The quantity Xi introduced in this 
way, however, has diverging moments. A way out of this problem is to resort to fluctuation-dissipation theorems. 
One may enforce a relation between Xi an d the average of a fluctuating quantity Xii Eq. (O, which holds also out of 
equilibrium. We have shown that the variances involving Xi have a very weak dependence on the particular choice 
of this fluctuating part, with the exception of the equal sites variance V£. For i ^ j, V*j is also a second-order 
susceptibility V*, which allows one to derive an equilibrium relation between variances, the SOFDT, analogous to 
the FDT for the averages. Interestingly, the FDT and the SOFTD can be written in a rather similar form, namely 
Eqs. (HHJ) and (fT3")) . expressing the vanishing of the first two moments of the quantity Dj(t,t w ) defined in Eq. (jlip . 
The SOFDT holds also for i = j but in this case cannot be interpreted as a variance. 

The SOFTD relates in a quite natural way V* to V$ promoting the former to a role analogous to that advocated 
for the latter in the context of disordered systems. This suggests considering V* on an equal footing with V^j and 
Vij X to study scaling behaviors and cooperativity. This we have done in the second part of the Article, considering 
ferromagnetic systems in and out of equilibrium. We have shown that V x , V c and V x obey scaling forms involving 
the coherence length £ in equilibrium or the growing length L(t) after a quench, similarly to what is known for C and 
X- Our result are in good agreement with what is found analytically in the spherical model [22| . They show that the 
time-re-parametrization invariance scenario proposed for glassy dynamics does not hold strictly for ferromagnets, as 
already guessed in [2^, [2l|. This we find both in critical or in sub-critical quenches, if the large-time limit is taken in 
the order lim tra _ ! . 00 lim^oo. Such a conclusion relies on the fact that VJLq/V^q — > oo in this particular limit and, 

hence, the fluctuations of x cannot be exclusively triggered by those of C. Notice that this is true also in critical 
quenches where I m is finite, sho wing that, quite obviously, a finite limiting effective temperature does not guarantee 
that the scenario proposed in [3, Il9j | necessarily holds. 
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Appendix I 

In this Appendix we first discuss a possible definition of the fluctuating part of Xi m a perturbed process (namely, 
after Eq. ([2])) and then show that for every choice of Xi one obtains the same variances except for V{f. 
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A. Definition of \i hi a perturbed process 

From Eq. ([2]) one has 

((Ti)h = (fi) + / J Xij(t,t w )hj(t w ), (40) 

3 

where now we consider a perturbing field switched on from t w onwards, and Xij is the two-point susceptibility. Using 
a random field with hj = and hjhj = h 2 6ij (where t^-t means an average over the field realizations) one can single 
out the equal site susceptibility as [36| 

1 



Xi(t,t w ) = -p{<Ji{t)) h hi(t w ). (41) 

We stress here that, in doing so, for computing Xi the perturbation does not need to be switched on only on the site 
i as in Eq. ([2]), and this allows one to consider higher moments, such as the variances V*-, where the field must be 
switched on on both sites i and j. Indeed one can introduce a (perturbed) fluctuating part of the susceptibility as 

Xi(*,0 = -k<n{t)hi{t w ), (42) 

and the correlator 



(Xi(t,t w )xj(t,t w )} = -^{(Tiitfajityhhitt^hjtfw). (43) 

B. Independence of the variances of the choice of \i 

For the sake of simplicity, let us consider a discrete time dynamics with two-time conditional probability given by 

t-i 

P(a,t\a' ,t w ) = [] w h (a(t' + l)\a(t')), (44) 
t'=t„ 

where a(t) is the configuration of the system at time t and Wh are the transition rates in the perturbed evolution. 
The linear susceptibility can always be written in the form 

t 

Xi(t,t w ) = wmo) ( 45 ) 

with m 

S\nw h (a(t> + l)\a(t>)) 

a i( t )= 7T~77F\ ( 46 ) 



Sh(t') 



h=0 



from which the fluctuating susceptibility can be defined in terms of unperturbed quantities as 

t 

= ai{t'). (47) 

Notice that depends on the particular form of the perturbed transition probabilities Wh- Then, since for a given 
unperturbed model there is an arbitrarity in the choice of the perturbed transition rates [l6l . |26| , one has different 
definitions of % an d, in principle, different Xi- However, as discussed in (26|,l30|, once the average is taken in Eq. (|45|). 
all these definitions are expected to yield essentially the same determination of Xii apart from very tiny differences 
which exactly vanish in equilibrium or in the large-time regime. With the definition (|47[) the following correlators can 
be built 

t-i t-i 

(Xi(t,t w )xj(t,t w )) = J2 (viMvj&aiWajit")), (48) 
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and 



t-i 



(Ci(t,t w )xj{t,t w )) = (°'i{t)vi(tw)vj(t)a j (t')) . 



(49) 



Even though these quantities explicitly depend on the particular choice of dj, we show in the following that they 
can all be written as (non-linear) response functions, which, therefore, are not expected to depend on the form of di, 
in the sense discussed above for \i- Indeed, considering for simplicity a single spin dynamics, using Eqs. (|44l and 
proceeding analogously to the derivation of Xi (Eq. (03), for i =/= j one can compute the following response functions 



R (2,2), / = 5 2 {a l {t)a ] {t)) h 



h=0 



and 



R 



(3,1) 



(^, tw :t?t ) 



a _ fl(Pift)o-i(f„,)crj(t))fr 



= {<7 l {t)(j i (t w )a J (t)aj(t 1 )). 



(50) 



(51) 



h=0 



Comparing Eqs. (|48l |49| with Eqs. (IBTJI [5Tj) one concludes that the correlators (I48I49P can be both related to response 
functions the value of which, as for Xi , are not expected to depend significantly on the choice of the form of the Wh 
(and hence of Oj). The same holds, therefore, for the variances Vgj and V° x . Incidentally, Eqs. (|48l50ll6j) show also 
that = Vfj for i ^ j. We stress that the above argument holds for every ij for V^ x whilst it cannot be extended 
to the equal site variance V£ , as we will show in Sec. IV CI Along the same lines, one can show that also the variances 
obtained with the perturbed fluctuating part (j42|) are related to the same response functions (|50|51|) . and hence take 
the same values. For instance, for the correlator (|4"3")l . since 



t\=t w t2—t w 



(52) 



h=0 



one has again 



(Xi{t,tw)Xj(t,t w )) 



t-i t-i 

E E 

t!=t w t 2 =tw 



(53) 



C. Equal sites 

In order to discuss the behavior of V?£ we compute explicitly this quantity and making the specific choice of 
Wh which leads to Eq. ©. Using the second order fluctuation-dissipation relations derived in [l6|, for Ising spins 

Rij'iJ (t, t; tifts) can be rewritten as 



- ^(ffi(*Vi(*)^(*i)Bi(*a)> 

- ^(o-i(*)^(*)Bi(ti)<7i(t 2 )) 

+ -S(ti -t 2 )S ij (a i (t) 2 B i (t 1 )a i (t 1 )). 



(54) 



Using the property o\ — 1 the term (ai(t) 2 B^t^a^ti)) can be cast as \{ai{t) 2 Bi{t\)) , where Bi = — J2a'i a ' ~~ 
a] 2 w(a'\<r). Writing this term in this form Eq. ((54)) holds generally for generic discrete or continuous variables. We 
will use this expression in the following. Integrating over t\ and ti one obtains 
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V x = 



~{((Ti(t)<Tj(t)[(Ti(t) ~ <Ti(t w )][(7j(t) - <7j(t w )]) 



dtMtfaWlaiit) - d % {t w )}B {t 2 )) 



dtx f dhiaityaji^Bi^Bjih))} 



+ -8ij j dti(ai(tyBi(ti)) - Xi(t,t w )xj(t,t w ). 



On the other hand, from the definitions (J7J and §5§ one has 

V£(t,t w ) = {Xi(t,t w )xj{t,t w )} -Xi(t,t w )xj(t,t w ) 



i r 

4 



(ai(t)<Ji(t)(Tj(t)aj(t)) - (ai(t)ai(t)aj(t)aj(t w )) 
dt 1 {a l {t)a l {t)a J {t)B l {t 1 )) - {a l {t)a J {t)a J (t)a l {t w )) 

+ {(Ti{t)(Ti{t w )<Jj(t)<Jj(t w )) + d*l(<Tt(t)0"j(t)5j-(i 1 )(7i(tt U )) 



^ 1 (<7 i (t)a i (t)a j (t)S i (t 1 ))+ / dhiaiitJajtyBiitJajitw)) 



+ J dhj dt 2 (ai(t)a j (t)B i (t 1 )B j (t 2 ))\-Xi(t,t w )Xjit,t w ). 
This shows once again that in the case i ^ j 

V*(t,t w ) = V? j (t,t w ). 

For equal sites, on the other hand, one obtains from Eqs. (|5"5l and (151))) the following relation 



where 



(with Aj defined below Eq. (JUJl) and 



V£(M«0 = V*(M™) + iff (*,*„,)<%, 



K*(t,t w ) 



dtMt) 2 Bi{t{)). 



(55) 



(56) 

(57) 
(58) 
(59) 

(60) 



This quantity has been studied in specific models in [30( and it is found to be positive and to diverge as t — t w increases. 
Finally, let us consider the equal site variance V% in the case when the perturbed definition ((32) is used. By forming 
products of Xi(t,t w ) one has 



V*(t,t w )=\mU S Xi (t,t w ) } = K, 

h— >0 L 



X 
i ' 



with 



Kf{t,t w ) = T 2 lim h- 2 - x? (*,*«.) 



(61) 



(62) 



This term diverges in the vanishing field limit. Since V£ is finite, this implies that V£ and V£ are necessarily different. 

In conclusion, with every definition of the fluctuating part the variances and V*- turn out to be the same, with the 
exception of which takes different values. 
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Appendix II 



In this Appendix we derive the equilibrium relation (|13p among the variances, for i ^ j. First, let us write explicitly 
the variances defined in Eqs. ^ and ([5]) with the help of Eq. 



Vij (t,t w ) — (Ci(t,t w )Cj(t,t w )) — Ci(t,t w )Cj(t,t w ) 



(63) 



V? x (t,t w ) = - (<Ji(t)(Ti(t w )crj(t)(Tj(t)) — ((Ti(t)ai(t w )aj(t)aj(t w )) 



dt 1 (<7 i (t)a :j (t)B j (t 1 )<j i (t w )) - {(Ti(t)}(<Ti(t w )}xj(t,t 



Ci(t, t w )xj(t, t w ). 



The variance V x can be read from Eq. (|56|) . 

In the following, we will use two properties involving the quantity Bi fl6l l26l 137 



(64) 



(65) 



(66) 



where 0(i) is a generic observable. In particular, at equilibrium, using time translation and time inversion invariance, 
from Eq. (|65|) one has 



{0(*) J B i (ti)) eg = - J-(O(i)^(t0)e g i > h, 



(67) 



where we have introduced the notation (. . .) eq to indicate the equilibrium dynamics. This relation allows us to perform 
the integrals f t dti(<Ti(t)<Ji(t)(jj(t)Bi(ti)) and J* dti(<Ti(t)<jj(t)<jj(t)Bi(ti)) appearing in Eq. ((55)) . This yields 



V*(t,t w ) = - [3((T i (t) ( 7 i (t)a- j (t)c7j(t))eg - 2{a i (t)a i (t)a j (t)a j (t w )) eq - 2{a i {t)a j {t)a j {t)a i {t w )) eq 
+ (a-i(t)cri(t w )crj(t)crj(t w )} eq + dt 1 {a i (t)cTj(t)B j (t 1 )a i (t w )) eq 

+ dti(a i (t)a j (t)B i (t 1 )a j (t w )) eq + £ dt x ^ dt^a^a^B^B^))^ 

- Xt( t , t w)Xj( t , t w)- (68) 
Moreover, exploiting again the relation (|67[) . the double integral appearing into Eq. (|68|) can be rewritten as 



dtx / dt 2 (cr i (t)<7 j (t) J Bi(il)-B j (t2)}e 9 

dtx £ dt 2 (^—^j(ai(t)a j (t)B i (ti)a j (t 2 ))e q 
+ £ dt 2 £ dt 1 (^-^{a i {t)(i j {t)B j {t2)ai{t l )) eq 

dt 1 {ai(t)a j (t)B i (ti)aj(t 1 )) eq + / dt 1 (a i (t)a j (t')Bi(ti)aj(t w )) eq 

ft pt 

dt 2 {ai{t)aj{t)Bj(t 2 )ai(t2)) eq + / dt 2 {ai(t)aj(t)Bj(t 2 )(Ti(t w )) eq 
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t rt 

dti(cr i (t)c7-j(t)B i (i 1 )c7-j(t u ,)} e9 + / d<i{o- i (t)(7 J (t) J B i (i 1 )o- i (t w )) e9 
' 9 

dtl — ((Tj (t)<7j (t)CTj {tl)(Ji {tl))eq 
t m Clti 

t pt 
dt 1 {a i (t)aj(t)B i (t 1 )aj(t w )} eq + / dti{o-i(t)cr J (t)_B J (ti)o-i(t, 1) )) e q 

+ {(Ji{t)(Ji{t)(Tj{t)(Jj{t)) eq - {<7i{t)<Jj(t)<Ti{t w )<Tj(t w )) eqi (69) 

where we have used the relation (pt?)) to obtain the third equality. Substituting this result into Eq. (|fJ8")) . one finally 
obtains 

V$(t,t w ) = ~ 4(<7 i (t)o- i (t)(j,-(t)£7-j(t)> e , -2(<7- i (t)(Ji(t)c7- J -(t)crj(t u ,)) e8 - 2(a j (i)a j (t)a i (t)a i (t w )) eq 

+ 2^ dt 1 (a i {t)a j (t)B j (t 1 )a i (t w )) eq + 2 £ dt^a^Oj^B^a^)), 

- Xi(t,tw)Xj (t,t w ). (70) 

Now, using the FDT Xi(t,tw) — t) — Ci(t,t w ) and assuming space translation invariance Ci(t,t w ) — Cj(t,t w ) 
and (<Ji(t)<jj(t)Bj(ti)(Ti(t w )) eq — (<Ji(t)<jj(t)Bi(ti)crj(t w )} eq , from Eqs. (1551) . and ([70)1 one obtains 

^f(t,t IU ) + 2l^ 7x (t,t lu ) + V^(t,t lu ) = (a(M)Q(M))e„ -Ci(t,t)Cj(t,t), (71) 
which is the equilibrium relation (|13[) . 

Appendix III 

In this Appendix we show that the quantity V^(t,t w ) at equal sites verifies the relation (fT8|) . In the case of Ising 
spins, since Rij'fj vanishes for i = j by definition, one immediately obtains = — x? , and, using the definitions (|63[) 
and and the property er(i) 2 = 1, one can easily check that Eq. (| 18[) holds. In the case of continuous variables, in 
equilibrium, using the property (|67p . from Eq. (|55|) one has 



V%(t,t w ) = ^{3(a l (t) 4 ) eq + (a l (t) 2 a l {t w ) 2 ) eq ^A(a l (t) 3 a l (t w )) eq +A^ dt 1 (a l {t) 2 B l {t 1 )<j t {t w )) eq 

dt 1 (a l {t) 2 B t {t 1 )a l {t 1 )) eq + j dtx{a i {tfB i {t 1 )) eq ^-Xi{t,t w f. (72) 



2 

The quantities appearing in the last two terms in the braces at time t\ can be rewritten as 

- 2B m + B l = -2 Y^'i - PiWMv'W) + + °i - H^Ma'\a) = ^[-of + ^\w{a'\a) (73) 

tr' er' a' 

yielding 

^i( f 7 i (t) 2 [-2S l (t 1 )a l (ti) + Bi(ti)])e, = / dti7j-(a 4 (t) 2 a 4 (<i) 2 ) eg = (<7<(t)% - (ai(t) 2 <Ti(t w ) 2 ) eq . (74) 
t w Jt w Ot\ 



Substituting this result into Eq. (fT2j). one finds 

Vl{t,t w ) = {ai(tf) eq - (<Ti(t) 3 ai(t w )} eq + £ dh^.it) 2 B^cj^)),^ - Xl {t 1 t w f (75) 
which coincides with Eq. (fT5|) . as can easily be checked recalling the definitions and (JHH). 
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Appendix IV 

In this Appendix we compute the large time limit of V , V c,x and V x , starting from an equilibrium state (t w > t eq ) 
and taking the limit t — t w — y oo. For the variance of the auto-correlation function one has 



lim V?(t,t w ) = lim {C l {t,t w )C ] {t,t w )) eq -C l {t-t w )C ] {t-t w ) 

' J + — t ... — Vi 



t— t m — too 



Cij t eq{Cij t eq + 2m 2 ), 



where factorization at large t — t w has been used, and m = (ui) eq is the equilibrium magnetization. 



For the covariance V? x (t,t w ) one has 



(76) 



lim V? x (t,t w ) = lim \-\Ci(t-t w )- (ai^aiit^it)^^)) 



eq 



dt 1 {a i (t)a j (t)B j (ti)(Ti(t w )) eq - m 2 Xj(t,t w ) - d(t - t w )xj(t - t w )\ 



m - {ai<jj) -2m {I - ((Ji<j 3 ) ) - lim / dti{ai(t)aj(t)Bj(ti)ai(t w )) eq 
m 2 (l — m ). 



(77) 



The integral can be computed in the following way. Introduce an intermediate time t* between t and t w and take t w , 
t* and t sufficiently far apart. Then one can write 



t* 



dt 1 (a i (t)aj(t)B :j (t 1 )ai(t w )) eq = / dt 1 (a i (t)a j (t)) eq {B j (t 1 )a i (t w )) 



+ J *i(cr i (t)a j (t)S J (ti))(o- i (t w )) eg . 
Using the property (1651) . the integral in the first term of the r.h.s can be rewritten as 



(78) 



di 1 (cr i (t)cr J (t)) eg (B j (t 1 )CT i (t u ,))eg = (<Ti(t)<Tj(t)) eq J dt 1 — (a J (ti)a l (t w )) eq 

= (a t (t)a J {t)) eq [(a j (t*)a l (t w )) eq - (o-j(t w )ai(t w )) eq ] 

2/ \ / \2 



171 ((Ti(Tj)eq ~ (^j) eq , 



(79) 



where in the last line the limit t* —> oo has been taken. Analogously, using the property (|67|) . the second term on the 
r.h.s of Eq. ([75)1 can be computed, yielding 



- m(m - {(Ti<j.j) eq m). 
Thus, replacing the integral appearing in Eq. (|77| with Eqs. ([79| and ([80]) one finds 



(80) 



lim V^ x (t,t w ) = -m 2 Cij. eq - 
From Eq. (TIT))) , by means of analogous computations, one can easily check that 



(81) 



Jim. V%(t,t w ) = -Cf jteq . 



(82) 
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